Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Incremental learning based proactive caching mechanism for RocksDB key-value system
Keyun LUO, Baoliu YE, Bin TANG, Feng MEI, Wenda LU
Journal of Computer Applications    2020, 40 (2): 321-327.   DOI: 10.11772/j.issn.1001-9081.2019091616
Abstract407)   HTML2)    PDF (723KB)(356)       Save

RocksDB key-value storage system based on Log-Structured Merge (LSM) tree has the problem of low read performance caused by the constraints of its hierarchical structure. One effective solution is to cache hot spot data proactively, but it faces two challenges. One is how to predict the hot spot data when the data distribution keeps on changing constantly, the other is how to integrate the proactive caching mechanism with the RocksDB storage structure. To tackle these challenges, a proactive caching framework for RocksDB key-value system with multiple components including data collection, system interaction and system evaluation was built, which can cache the hot spot data at the low levels of the LSM tree. And with the modeling of data access patterns, an incremental learning based prediction analysis method for hot spot data was designed and implemented, which can reduce the number of I/O operations of storage medium. Experimental results show that the proposed mechanism can effectively improve the read performance of RocksDB under different dynamic workloads.

Table and Figures | Reference | Related Articles | Metrics